Preprint typeset in JHEP style. - HYPER VERSION 



CERN-TH/2001-243 
December 2001 



Improving the discovery potential of 
charged Higgs bosons at Tevatron Run 2 

Monoranjan Guchait and Stefano Moretti 

CERN - Theory Division, CH-1211 Geneva 23, Switzerland 
Emails: monoranjan. guchait@cern.ch, stefano. moretti@cern.ch 



Abstract: By exploiting the full process pp — * tbH~, in place of the standard Monte 
Carlo procedure of factorising production and decay, pp — > tt followed by t — > bH~ , 
we show how to improve the discovery reach of the Tevatron (Run 2) in charged 
Higgs boson searches, in the large tan/3 region. This is achieved in conjunction with 
dedicated cuts on a 'transverse mass' distribution sensitive to the Higgs boson mass 
and to 'polarisation' effects in the H'^ t~j?j. decay channel. 
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1. Charged Higgs bosons at the Tevatron 

The importance of charged Higgs boson searches at future colliders has in the recent 
years been emphasised more and more the detection of a 'scalar charged' par- 

ticle would in fact definitely signal the existence of New Physics beyond the Standard 
Model (SM). Such states are naturally accommodated in non- minimal Higgs scenar- 
ios, such as Two-Higgs Doublet Models (2HDMs). A Supersymmetric version of the 
latter is the Minimal Supersymmetric Standard Model (MSSM) - in fact, a Type 11 
2HDM with specific relations among neutral and charged Higgs boson masses and 
couplings, as dictated by Supersymmetry (SUSY) 

The Tevatron collider at Fermilab has just begun its second stage of operation, 
so-called Run 2, with a higher centre-of-mass (CM) energy {y/s = 2 TeV) and a 
prospect of collecting something like 15 fb~^ of luminosity (per experiment) by the 
end of its lifetime. This machine will be the first one to probe charged Higgs boson 
masses in the mass range Mh± ^ rrit 0. At present, a lower bound on the charged 
Higgs boson mass exists from LEP [Q, Mh± > Miy±, independently of the charged 
Higgs branching ratios (BRs). This limit is valid within a general 2HDM whereas, in 
the low tan/? region (say, below 3), an indirect lower limit on Mfj± can be derived in 
the MSSM from the one on Mho (the mass of the lightest Higgs state of the model): 
M2 ± ^ M^^ + Mlo > (130 GeV)2. 

The main production mode of scalars at the Tevatron, for Mh± < m^, is the 
decay of top (anti)quarks, the latter being produced via QCD in the annihilation 
of gluon-gluon and quark-antiquark pairs. Simulation studies aiming to assess the 
discovery reach of the Tevatron in the quest for charged Higgs bosons have relied 
so far on Monte Carlo (MC) programs, such as PYTHIA §, HERWIG and 
ISAJET [Q. Here, the above process is accounted for through the usual procedure 
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of factorising the production process, gg, qq tt, times the decay one, i bH^ , in 
the so-called on-shell top approximation. 

It is the purpose of this letter to show how this description fails to correctly 
describe the production and decay phenomenology of charged Higgs bosons when 
their mass approaches the top one, hence undermining the ability of experimental 
analyses at Tevatron in pinning down the real nature of these particle (if not detecting 
them altogether). We will do so by comparing the results obtained in the above 
approximation with those produced through the full processes gig2, qiq2 tsb^H^ 
[|], proceeding via the following graphs: 




2 4 2 4 




2 4 2 4 



In fact, we will argue the latter being the correct way to describe charged Higgs 
boson production and decay in the 'threshold region': Mh± ~ mt. Specifically, we 
will be exploring Higgs mass values beyond the customary 160 GeV limit considered 
in Run 2 studies 0, while remaining below 190 GeV, where the production cross 
section is below detection level. 

Finally, we will proceed to a signal-to-background analysis, the latter incorpo- 
rating dedicated selection procedures already advocated in literature, in order to 
illustrate how the discovery potential of the Tevatron can be improved, in the 
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context of so-called 'direct' (or 'appearance') searches |jlO[- In such a case, specific 



decay modes of charged Higgs bosons are searched for and kinematical selections are 
optimised to extract one or another decay signature. In contrast, in 'indirect' (or 
'disappearance') searches |Tl|, one employs selection criteria optimised to detect the 
SM decay of a top (anti) quark, t — * bW^ bX, and any loss of such events can be 
ascribed to the presence of t bH^ bX decays. As remarked in the latter 
method is expected to yield stronger (null) results for integrated luminosities below 
2 fb~^ or so, whereas with increasing statistics (and, possibly, enhanced detector per- 
formances) the former is expected to dominate. Conversely, if a charged Higgs boson 
exists with mass around m^, its presence could be detected through a disappearance 
search, hence prompting a direct search to confirm discovery. 

In this note, among the possible decay signatures of states, we will concen- 
trate on the H t^v^ channel, which is the dominant one for our considered range 
of Mii± . The H bi signature originating from tbH~ final states has already been 



considered (for relatively higher Mh± values) in Ref. |jT2|. For a review of typical 
decay rates of charged Higgs bosons, see Ref. 



2. Charged Higgs boson production in the threshold region 

The subprocesses in ( |1.1| ) account for both top-antitop production and decay (graphs 
G3, Gq and Gs for gluon-gluon and Q2 for quark-antiquark) as well as for Higgs- 
strahlung (all other graphs) and the relative interferences. In fact, in order to emulate 
the current implementation in MC programs, one can extract the top-antitop graphs 
in a gauge invariant fashion, by setting Gi = G2 = G4 = G^ = G^ = plus Qi = 0, 
and rewriting, in the fixed width scheme, the top propagator as (here, p = p4 + ps) 

. ^:r' , i^t (2.1) 

When Vt = Ftot, the total top width, the standard expression is recovered. The on- 
shell or Narrow Width Approximation (NWA) can be obtained by taking numerically 
Ft ^ 0, as in this limit eq. (|2.1|) becomes a representation of the Dirac delta function 
5{p'^ — rrij) (apart from a factor vr). In practice, the cross section coincides with 
the one computed as production times BR already for F^ ~ 10~^. For the width of 
the top-quark we have used the tree-level expression, which depends upon both Mh± 
and tan j3 (the ratio between the vacuum expectation values of the two doublet Higgs 
fields). Similarly, we have proceeded with the couplings entering the tbH~ vertex. 

In Fig. |I|, we compare the total cross section obtained by computing processes 
( |1 . 1| ) (with Tt = Ftot) to the tt-mediated one in NWA, i.e., gg, qq tt —>■ tbH^ with 
Ft ^ 0. These results are both gauge invariant. For the sake of illustration, we also 
have included here similar rates obtained by computing the top-antitop diagrams 
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only, with Tt = Ttot (these are subject to a gauge dependence of order 0(Tt/mt)y. 
Cross sections are shown for two representative tan/5 values (3 and 30) over the 
mass range 160 GeV < Mh± < 190 GeV. However, since the effect that we are 
investigating is merely kinematical, the same quantitative features would appear 
for other choices of the former. It is evident how, with Mh± approaching m^, the 
Higgs boson rates are grossly mis-estimated by the NWA. Hence, it is mandatory to 
exploit in future MC simulations of if^ production and decay around the threshold 
region an implementation based on the gg, qq — > tbH~ matrix elements. Besides, 
for Mh± > rrit — mt, only the latter can produce a non-zero result. Our default 
values for rrit and are 175 and 4.25 GeV, respectively, both in the couplings and 
kinematics^. 

Also differential distributions can strongly be affected by an approximated mod- 
elling of the production process in the threshold region. In Fig. |^, we present the 
spectra in transverse momentum of the top and bottom quarks, for the full 2^3 
process and the NWA. Whereas differences in px are negligible in the case of the 
Higgs boson (so that this case is not plotted here), they are sizable for the top and 
dramatic for the bottom quark. Whereas one should expect the impact of the dif- 
ferences seen in the top quark distribution to eventually be marginal, owning to the 
fact that this particle is actually unstable and that its three-body decay products are 
subject to the (cumulative) effect of usual detector resolution uncertainties, this is 
no longer true for the bottom quark, which fragments directly into hadrons. Besides, 
the availability of the newly implanted silicon vertex detector may render the tag- 
ging of 6-quarks a crucial ingredient in detection strategies of charged Higgs bosons 
at Run 2. Results in Fig. |^ are shown for Mh± = 170 GeV and tan/5 = 3. Whereas 
the described effects are insensitive to the actual value of the latter, a difference 
choice of the former can modify the relative shape of the two curves (full and NWA) 
significantly, but the distinctive features seen here remain qualitatively the same for 
any choice of Mh± in the considered mass interval. 

Before moving on to the decay analysis, one final remark is in order concerning 
the production stage. In Fig. |I], we also have presented the cross sections of the 
so-called 'Drell-Yan mode', qq —>■ H^H^ [0^' followed by —>■ tb. This is the 



^They are meant to illustrate what portion of the difference between the full results and those in 
NWA is due to finite width effects of the top-quark, the remainder of it coming from the contribution 
of the other diagrams and the relative interferences. 

^When we will discuss decay rates of the charged Higgs boson, the two masses above will be the 
input values of HDECAY - the package that we used for our numerical estimates. 

■^In fact, this nomenclature is somewhat misleading, as bb H^H^ contributions proceeding 
via double Higgs-strahlung or neutral Higgs boson mediation (e.g., h^,H^ and in the MSSM), 
as opposed to gauge boson exchange, i.e., qq — + ^*,Z* — > H~^H~, are not entirely negligible, 
particularly at the LHC, where they are in fact dominant at large tan/3 - similarly for the loop- 
induced contributions, gg H^H^ |T^. (Notice that we include all such subprocesses in our 
calculation.) 
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only process competing with gg, qq —>■ tbH^ at Tevatron energies, at least in the low 
to intermediate tan/3 region, say, 1 < tan/5 < 10. (At the Large Hadron Collider 
(LHC), many more production modes exist In principle then, one should also 

investigate the qq H^H^ — > thH^ channel, alongside gg,qq tbH~ in ( |1 . 1| ) . 
In practice, though, in direct investigations of the H r^Ur decay channel, one 
is implicitly concerned with large tan/? values only. The reason is twofold. On the 
one hand, an appearance search in the threshold region with a very low tan (3 (say, 
below 1.5) would have to be based on H~ —>■ sc decays, which are very challenging 
because of an overwhelming QCD noise; whereas for tan/5 = 2-3 one finds that 
H± ^ decays can be relevant (see for some LHC studies), and these 

are strongly model dependent (e.g., in the MSSM they are no longer viable, given 
the recent limits on Mf^o from LEP in this scenario). To date, CDF [|iy] has only 
published results for H T^i?r, which are valid for tan/? > 4. On the other hand. 



for tan /? close to ymt/rrib, the strength of the tbH~ coupling - entering the diagrams 
in (|1 . 1|) - reaches a minimum, in the end rendering the production cross section 
unobservable. This basically occurs over the interval 4 < tan (3 ^ 10. Besides, for 
Mfj± ~ rrit and tan/5 > 10, the —>■ r^Vr decay mode is truly dominant, as one 
can appreciate by combining the production cross sections of Fig. |1| with typical 
decay rates This is made clear in the left-hand side of Fig. ^ for a general Type 
II 2HDM (note the relevance of H~ bB*^ off-shell decays at low tan/5 even well 
below Mh± = mt+mb). The statement remains true also in the case of charged Higgs 
boson decays into Supersymmetric particles |]19|, as could well happen in the MSSM 
(according to current experimental limits). For example, in the right-hand side of 
Fig. ^ we display the corresponding a x BR rates in the MSSM with M2 = 130 GeV 
and u = 300 GeV, yielding: M-± ^ 330, 106 GeV and M-± ^ 58, 109, 304, 331 

wo Xi,2 ' Xl, 2,3,4 ' ' ' 

GeV (for tan/5 = 3); M-± ^ 118,326 GeV and M-± ^ 63,119,309,322 GeV 
(for tan/5 = 30). Here, M-± and M^o are the two {i = 1,2) chargino and four 

Xi Xj 

{j = 1,2,3,4) neutralino masses, respectively. In fact, the dominant decays into 
Supersymmetric particles of bosons are those into chargino-neutralino pairs, 
since typically one has Mh± > M-± + M^o for some ij combination (see Ref. [pOjl, 
where more plots along the same lines can also be found). We defer the detailed 
investigation of the low to intermediate tan/? interval to pT| . 



3. Signal selection in the H t Vr channel 

The signature of interest here is pp tbH^, followed by H T^i?r, with the top 
quark decaying hadronically, t — > bqq'. The same type of event topologies may appear 
in the SM process pp — > tbW^ —>■ tbT^v^, which is in fact the dominant irreducible 
background. This should be clear, if one notices that one of the subprocesses entering 
the background is pp ^ ti ^ tbW~, i.e., top-antitop production and decay in the 
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SM, for which one has a{pp —>■ tt) 7-8 pb at Tevatron for ^/s =2 TeV (in our 
calculation, the full set of tree-level diagrams leading to thW~ final states has been 
computed) . 

The r's can be tagged as narrow jets in their 'one-prong' hadronic decay modes, 
which represent 90% of the hadronic decay rate and about 50% of the total one. 
The main components of such decays are: — ^ 7r^z/^(12.5%), p''^z/t-(24%) and 
a^z/T-(7.5%), with in turn tt^tt*^ and af -n^-n^-n^ . This distinguishing fea- 

ture is in contrast to the typical appearance of quark- and gluon-jets, which yield 
'multi-prong' hadronic topologies in the detectors. This characteristic difference can 
profitably be exploited to efficiently isolate the hadronic r-signals from QCD back- 
grounds of the form + jets and -|- jets, which we have then ignored here. 

We have studied our signal and background processes using a very simple parton- 
level MC analysis, i.e., without taking into account fragmentation effects of partons. 
In our numerical calculation we have set the renormalisation and factorisation scales 
equal to the partonic CM energy, = s, and the CTEQ4M ||2^ Parton Distribution 
Functions were used throughout. For the selection of events, we have adopted the 
following set of cuts in transverse momentum, px, and pseudorapidity, r], as well as 
transverse missing momentum, "^j,. 

1. Tau-jets are selected if they satisfy the following criteria: p'^ >15 GeV and 
\r]^\ < 2.5. 

2. We require ^j. > 20 GeV, since the presence of neutrinos from decays and 
invisible decay products of r's (mainly vr^'s) implies that a significant fraction 
of transverse momentum goes undetected. 

3. Quark-jets are selected by imposing pj^ > 20 GeV and \ri^ < 2.5. We require 
at least one of these to be tagged as a 6-jet. 

4. We demand that two un-tagged jets have an invariant mass around M\y±, e.g., 
\Mqq' — My/±\ < 10 GeV and that the 6-jet in combination with other two 
un-tagged jets produces an invariant mass close to rrit, e.g., \Mi,qqi — mt\ < 15 



After the implementation of these cuts, we have found that the cross section for the 
signal is, e.g., 0.6(5.5) fb for Mh± =170 GeV and tan/3 = 3(40); whereas for the 
background process one has 90 fb. Clearly, signal-to-background ratios (S/B's) of 
this sort are insufficient to establish the presence of states. Hence, further cuts 
have to be devised. 

To this end, we have exploited another kinematic variable: a transverse mass, 
Mt, constructed from the visible r-jet and the missing energy, i.e.. 



GeV. 




(3.1) 
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as introduced in Ref. ||23|. In the case of the signal, the r-jets are heavily boosted rela- 
tively to the case of the background, as the charged Higgs masses considered here are 
much heavier than M\y±. This leads to a backward (forward) peak in the azimuthal 
angle distribution, A0, identified by the directions of the r-jet and the missing mo- 
mentum in the signal (background): see Fig. ^ By imposing > M\y± 80 GeV, 
the background is reduced by more than two orders of magnitude, while the signal 
cross section is suppressed to a much lesser extent. For example, for Mh± =170 
GeV, the latter becomes 0.4(3.5) fb for tan/3 = 3(40) while the former comes down 
to a manageable 0.22 fb. In Tab. 1 we summarise the signal and background cross 
sections for some representative values of Mh± and tan /?, after all cuts described 
above. 



Before converting the numbers in Tab. 1 into event rates and significances, one 
has to take into account the finite efficiency of the detectors in particle identifica- 
tion. For example, r-identification efficiencies are estimated to be of order 50% |P^], 
similarly for the tagging of any 6-jet p|. Hence, one should more realistically expect 
both signal and background rates to be further reduced by a factor of 4 or so. In 
the end, however, the chances of extracting the if^ — *■ r^z/,- signal after 15 fb^^ of 
luminosity are rather good, at least at large tan /3, while being negligible at low to 
intermediate values of the latter (as already argumented). Notice that this remains 
true for charged Higgs masses above rrit as well, say, up to 180 GeV or so, where a 
handful of signal events should survive in each experiment. 



This situation is rather encouraging, especially considering that there may be 
some room to further improve the S/B^s if one recalls that the distributions of one- 
prong hadronic decay tracks of r's are strongly sensitive to the polarisation state of 
the lepton (see, e.g., Refs. |2^, |26| for a detailed discussion). Basically, the key feature 
relevant to our purposes is the correlation between the latter and the energy sharing 
among the decay pions. In fact, it is to be noted that the spin state of r's coming from 
if^- and I^^'^-boson decays are opposite: i.e., H Tr^r and 'Tl^l whereas 

t^ur and t~r^l (neglecting leptonic mass effects, as we did here). 

Ultimately, this leads to a significantly harder momentum distribution of charged 
pions from r-decays for the if^-signal compared to the VT^-background, which can 
then be exploited to increase S/B. This is true for the case of one-prong decays 
into both tt^'s and longitudinal vector mesons, while the transverse component of 
the latter dilutes the effect and must be somehow eliminated. This can be done 
inclusively, i.e., without having to identify the individual mesonic component of the 
one-prong hadronic topology. In doing so , we will closely follow Ref. pH . 



The mentioned transverse components of the signal as well as those of the back- 
ground can adequately be suppressed by requiring that 80% of the r-jet (transverse) 
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energy is carried away by the tt^'^'s, i.e.: 

R= — >0.8. (3.2) 

Pt 

The enforcement of this constraint reduces by a factor of 5 the background, while 
costing to the signal a 50% suppression (for any relevant charged Higgs mass). 

Incidentally, we should mention that acceptance efficiencies for the selection pro- 
cedure that we have chosen here are very similar in the case of the signal for both 
the 2 — > 3 simulation and the NWA. However, this should not be surprising, as we 
have imposed no requirement of a second 6-tag. In fact, in most cases, only one 
6-quark enters the detector region - the one produced in the (hadronic) decay of the 
top quark in the tbH~ final state. In contrast, things would be rather different if two 
6-tags were asked, both at > 20 GeV, as it should be clear from the right-hand 
side plot in Fig. ||. 

4. Conclusions 

In summary, we have demonstrated that concrete prospects exist at Tevatron Run 2 
of extending the discovery reach of charged Higgs bosons up to masses of order rrit, 
in the large tan f3 region, in the context of direct searches. This can be achieved by 
combining the following ingredients. 

• To emulate the production of charged Higgs boson events by resorting to the full 
gg,qq tbH~ process, as opposed to the traditional procedure of generating 
the scalar particles in on-shell top decays, from gg, qq ti events. In fact, the 
former not only includes the dynamics of the latter, but also embeds charged 
Higgs production from Higgs-strahlung and relative interferences. 

• To search for 'one-prong' hadronic decays of r-leptons produced in H~ 
T^Ur events, in presence of a single 6-tag, usual detector requirements and 
after W^- and t-mass reconstruction in the accompanying hadronic system, 
t bW+ jets. 

• To enforce a cut in a typical transverse mass {Mt) distribution, which is bound 
to assume values below the particle yielding the r-leptons {H^ for the signal 
and for the background). Besides, since a cut as low as Mt > My/± is 
sufficient to reduce the background to negligible levels, the same distribu- 
tion can also be used to eventually fit the unknown charged Higgs boson mass, 
when Mh± ~ m^. 

• Finally, to exploit well-known polarisation effects in the case of tc^i^t, 
p^Uj- and afur decays. 
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In drawing our conclusions, we have relied on a parton-level analysis. However, 
we expect that its main features should remain valid even in presence of fragmen- 
tation/hadronisation effects. We do advocate a selection procedure along the above 
lines to be investigated at a more phenomenological level (including realistic detec- 
tor simulations) by the Tevatron experiments. For example, the mentioned 2^3 
description of the production dynamics is available since version 6.3 in the HER- 
WIG event generator pSf while polarised r-decays are now implemented in version 



6.4 m (also including an interface to TAUOLA |30|). 

In order to motivate such analyses, we propose a benchmark scenario that may 
eventually emerge from these. In Fig. ^, we present the exclusion regions, below 
the level curves, in the tan/3-M//± plane that can potentially be explored at 95% 
confidence level (CL) at the upgraded Tevatron, for two luminosity options, 5 and 15 
fb~^, by using the tools and the strategy outhned here. The significances a = S/\fB 
used for the contours in Fig. ^ have been estimated at the parton level, after the 
sequence of cuts in 1.-4. and the one in transverse mass, Mt > M\y±, hence before 
the one in (|3.2| ) and without including the mentioned efficiencies. Incomplete as 
these estimates might be at this stage, it is clear the dramatic improvement (both in 
tan P and Mh± reach) that could be achieved, if one compares our plot to Fig. 102 
of Ref. m. 
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Figure 1: Cross section for gg,qq tbH^ (solid), gg,qq tt ^ tbH~ (dashed, with 
finite top width) and gg, qq ^ tt ^ thH^ (dotted, in NWA), at y/s = 2 TcV, as a function 
of Mu± for two representative values of tan (3 (hereafter, charge conjugated rates are always 
included). For comparison, we also have plotted the cross section for qq H^H~ tbH" 
(dot-dashed). (Notice that the rates for the latter have been multiplied by 10 for the case 
tan /? = 30, for readability.) 
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Figure 2: Transverse momentum distributions of the three-body final state top- (left) and 
bottom-quark (right) in gg, qq thH~ (solid) and gg, qq ^ ti ^ tbH~ (dashed) (the latter 
in NWA), at ^ = 2 TeV, for Mh± = 170 GeV. (Notice that the spectra are independent 
of the choice of tan/3.) 




Figure 3: Cross section for gg, qq tbH~ times the BRs in all relevant decay modes of 
charged Higgs bosons, at = 2 TcV, as a function of Mjj± for tan (3 = 3 (solid) and 30 
(dashed). On the left-hand side, we assume that decays into Supcrsymmetric particles are 
prohibited. On the right-hand side, we include them, by adopting an MSSM setup with 
M2 = 130 GeV and /x = 300 GeV (see the text for the sparticle masses). 
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Figure 4: Transverse mass distribution, as defined in eq. ( |3.1D , in gg,qq — > tbH~ , for 
Mfj±=160 and 180 GeV (long- and short-dashed, respectively), and gg, qq — > tbW~ (solid), 
after the cuts 1.-4. described in the text. (Notice that the signal spectra are independent 
of the choice of tan/3.) 
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Mh± (GeV) i / tan/3 ^ 


3 


6 


40 


tbW- 


150 


6 


3 


52 


0.22 


160 


2.8 


1.5 


22 


0.22 


170 


0.4 


0.25 


3.5 


0.22 


175 


0.13 


0.08 


1.42 


0.22 


180 


0.067 


0.061 


1.09 


0.22 



Table 1: The cross section (in fb) for the signal qq,gg thH^{-^ t~D-t) and the back- 
ground qq,gg tbW~{-^ t^v.^), at = 2 TeV, for representative values of Mfj± and 
tan/3, after all cuts described in the text. (Notice that the background rates are indepen- 
dent of Mh± , as the transverse mass constraint that we adopted does not depend on the 
latter.) 
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